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ABSTRACT 

This  paper  addresses  the  problem  in  which  jobs  of  different 
types  arrive  at  a  system  that  consists  of  a  collection  of  individual 
and  somewhat  diverse  processors.  The  processors  differ  in  that 
each  may  specialize  in  one  job  type,  but  may  also  do  others.  Job 
types  that  are  totally  incompatible  with  a  processor  have  an  infinite 
service  on  that  processor,  but  degrees  of  incompatibility  may  exist, 
and  are  modeled  here.  Using  static  queuing  models,  several 
practical  performance  measures  may  be  evaluated,  and  optimal 
allocation  of  jobs  to  processors  are  obtained  by  solving  linear  and 
nonlinear  programming  problems.  To  illustrate,  several  numerical 
examples  are  provided.  It  is  shown  that  jobs  are  not  always  most 
advantageously  assigned  to  their  most  expert  servers. 

1.  Problem  Formulation 

Consider  a  service  system  whose  individual  service  facilities  (servers)  are 
unequal  in  their  capacities  to  serve  different  job  types.  This  means  that,  in  some 
sense,  a  job  of  type  j  is  most  expeditiously  done  by  a  server  of  type  i  =  i(j),  and 
quantifiably  less  so  by  other  servers.  It  may  well  be  that  a  good  start  is  achieved 
by  assigning  jobs  to  those  servers  who  require  the  least  mean  time  to  finish  them. 


but  clearly  this  is  not  optimal  if  it  tends  to  overload  a  few  efficient  servers  and 
leaves  others  idle.  A  good  d5mamic  approach  might  be  to  allocate  the  excess 
backlog  of  the  efficient  servers  to  others  whenever  that  backlog  is  excessive.  But 
this  requires  constant  monitoring  of  queue  lengths,  or  possibly  current  elapsed 
job  service  time.  We  do  not  investigate  such  dynamic  rules  here. 

We  propose  to  study  a  static  queuing  model  that  selects  from  the  incoming 
job  traffic  stream  of  jobs  of  classes  ;  =  1, 2, . . .,  /  a  subset  that  is  directed  to  each  of 
the  available  servers:  if  a  job  is  of  type  j  it  goes  to  server  type  /  with  probability 
flyj.  The  procedure  is  based  on  classical  M/G/1  queuing  theory,  and  requires 
mathematical  programming  in  order  to  optimize  the  allocation  from  the 
perspective  of  either  servers  or  jobs  (customers).  The  allocation  can  be  both 
deterministic  or  randomized.  In  the  deterministic  case,  all  jobs  of  one  type  are 
assigned  to  a  single  server.  For  the  randomized  allocation,  if  a  job  of  type  j 
arrives,  it  can  be  assigned  to  server  /  with  probability  flyf. 

2.  Model 

The  system  studied  is  made  up  of  /  >  1  single  servers  with  different 
capabilities.  The  system  is  confronted  by  a  Poisson  (rate  X)  rate  of  demand  of 
jobs,  but  of  different  job  types:  with  independent  probability  pj  an  arrival  is  a  job 
of  type  /,;*€  (1, 2, ...,/).  The  different  capabilities  of  servers  to  handle  (serve)  jobs 
of  different  types  is  reflected  in  their  service  times:  the  service  time  of  job  /  on 
server  /,  denoted  by  Sji,  may  tend  to  vary  systematically  with  /  for  any  of  many 
possible  reasons,  one  being  each  of  training  or  recent  experience  by  i  with  job 
type/.  In  fact,  for  some  job  types  /  and  some  servers  /',  Sj'f  is  effectively  infinite  if 
the  servers  in  question  have  no  capability  to  handle  those  particular  jobs,  so 
E[Sj'i']  =  oo;  this  is  a  case  of  total  incompatibility,  and  certainly  exists  in  many 
practical  settings.  On  the  other  hand  it  may  be  necessary  to  allocate  jobs  to 
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servers  with  which  they  are  somewhat  incompatible  in  order  to  avoid 

overloading  the  more  compatible  servers.  It  is  to  be  expected  that  this 

phenomenon  may  tend  to  occur  more  extensively  as  traffic  intensity  increases, 

e.g.  if  A  increases,  in  which  case  a  good  planning  policy  choice  of  ay/  may  well 

stave  off  disaster:  the  need  to  hastily  add  servers  or  reject  jobs. 

To  investigate  the  effect  of  cross-assignment  we  introduce  a  static  set  of 

assignment  probabilities  fly/.  Thus  if  a  type-;  job  arrives  in  (f,  t  +  dt)  with 

probability  Xpjdt  +  oidt),  it  is  assigned  to  server  i  with  probability  fly/.  We  think  of 

fly/  as  a  decision  variable  to  be  determined  so  as  to  optimize  some  measure  of 

system  performance.  Total  expected  delay  to  all  arriving  jobs  is  one  such 

measure,  but  the  delays  of  some  jobs  may  be  more  undesirable  than  those  of 

others,  in  which  case  a  total  weighted  expected  delay  can  be  studied.  Note  that, 

for  job  type  ;,  we  can  select  fly/  to  be  any  real  positive  (actually  non-negative) 
I 

number  such  that  ^fly/  =  1,  in  which  case  a  randomization  device  is  needed  to 
i=l 

allocate  an  arrival  of  type  y  to  its  server,  i.e.,  fly/  represents  a  randomized  job 
allocation.  A  more  easily  implemented  approach  would  be  to  choose  a  single 
"best"  z-value.  Up  for  each  ;,  and  set 

1  if '■  =  '■(/) 

—  ] 

[0  Otherwise. 

This  approach  is  a  deterministic  allocation  of  jobs  since  it  sends  all  jobs  of  type; 
to  server  i{p.  Later,  it  is  shown  that,  although  easier  to  implement,  deterministic 
job  allocation  may  not  be  desirable  in  practice. 

Both  deterministic  and  randomized  job  allocations  provide  a  simple 
independent  Poisson  stream  of  jobs  with  independent  service  times  to  the 
individual  servers.  Moreover,  if  jobs  are  treated  in  arrival  order  (first-come,  first- 
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served)  at  all  servers,  the  stationary  delay  experienced  at  each  of  the  I  servers  can 
be  calculated  using  known  results,  e.g.  the  Pollaczek-Khintchine-Kendall 
formula.  Parenthetically,  static  priority  rules  can  also  be  followed,  and  formulas 
for  long-run  results  are  already  available,  but  this  extension  is  postponed. 

Clearly  the  arrival  rate  at  server  i  of  all  job  types  is 

7 

k  =  7  =  1, 2, . . .,  /  (2.1) 

;=i 

and  by  standard  results  Xi  is  the  rate  of  a  Poisson  process  independent  of  those 
prevailing  for  other  servers  i).  Now  consider  the  effective  service  time,  S,-,  of 
jobs  arriving  at  server  i.  A  new  job  is  of  type  /  with  probability  pj,  and  if  it  is 
dispatched  to  server  i  it  experiences  service  time  Sji,  so 


S,-  =  Sjj  with  probability  . 

Pi 

Moments  of  Sf  are  calculated  by  conditioning,  e.g. 


7 


jn. 

Also  the  Laplace  transform  is 

jpi- 


(2.2) 


(2.3) 


(2.4) 


(2.5) 


This  latter  becomes  useful  in  case  one  wishes  to  use  the  probability  of  a  long  wait 
or  delay  as  an  optimization  criterion;  see  Gaver  and  Jacobs  (1988). 
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3.  Performance  Measures 

Several  service-system/ queuing  performance  measures  are  relevant  to  overall 
system  performance  and  can  be  formally  evaluated.  Then  mathematical 
programming  techniques  can  be  applied  to  obtain  optimal  {ay/}  values. 


3.1  Traffic  Intensity  Parameters  and  Associated  Optimization  Problems 

It  has  already  been  stated  that  Aj-  =  Ap/,  and  that  E  [Pif  so 

;=i 

tile  I'th  server's  traffic  intensity  is 


7  r  T 


Using  (3.1),  several  optimization  problems  can  be  formulated  from  the 
perspective  of  the  servers.  The  first  problem  is  to  find  a  job  allocation  that 
minimizes  a  linearly  weighted  combination  of  the  traffic  intensities,  i.e.,  solve  the 
following  optimization  problem. 

I  J 

PI:  min  A^q 

t=l  7=1 

7  ,  , 

subject  to  A^PyflyjEpy,  J<lVl  =!,.../  (3.2) 

7=1 


=  l  V/  =  l,.../ 


aji^O  V/  =  l,.../;  7  =  1,.../  (3.4) 

where  the  first  constraint,  (3.2),  restricts  the  traffic  intensity  for  each  server  i  to  be 
less  than  one  in  order  to  ensure  the  existence  of  long-run  stationary  delays.  The 
second  constraint  ensures  that  the  probability  that  job  type  7  is  assigned  to  server 
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i  sums  to  one.  The  parameter  Ci  in  the  objective  function  is  the  weight  for  the 
traffic  intensity  of  server  z.  When  cj  =  1,  the  objective  function  is  equivalent  to 
minimizing  the  average  traffic  intensity  of  the  I  servers. 

When  X  is  sufficiently  small,  allocation  aji  satisfying  constraints  (3.3)  and  (3.4) 
may  automatically  satisfy  constraint  (3.2)  and  it  may  be  eliminated.  In  this  case, 
problem  PI  has  a  simple  solution.  By  interchanging  the  two  summations,  the 
objective  function  for  PI  can  be  equivalently  written  as 

J  I 
/=!  f=l 


For  each  job  j,  let  i  (/)  =  arg  mm{ciE[Sji] ;  z  =  1, . . .  7}  and  allocate  jobs  as  follows: 


ifz  =  /(/) 
otherwise 


V/  =  l,.../. 


(3.5) 


The  allocation  in  (3.5)  clearly  satisfies  (3.3)  and  (3.4).  Moreover,  it  is  also  assumed 
to  satisfy  (3.4)  when  X  is  sufficiently  small.  By  construction,  i  (/)  is  the  least  cost 
server  and,  when  q  =  1  for  all  z,  z  (;)  is  the  "best"  or  the  most  qualified  server  for 
job  /.  Since  assigns  job  j  to  its  least  cost  server,  the  corresponding  objective 

function  value  must  also  be  minimal.  So  the  randomized  and  deterministic  job 
allocations  are  the  same  when  X  is  sufficiently  small. 

When  X  is  too  large,  the  allocation  in  (3.5)  may  not  be  feasible.  In  fact,  there 
may  not  exist  any  feasible  deterministic  job  allocation  and  the  probabilistic  job 
allocation  may  be  the  only  choice.  In  which  case,  it  is  still  optimal  to  assign  the 
major  proportion  of  job  j  to  server  i[j).  To  minimize  total  cost,  it  is  only 

necessary  to  divert  just  enough  of  jobs  j  to  other  servers  to  ensure  that  constraint 
(3.2)  is  satisfied.  In  practice,  this  may  not  be  acceptable  since  server  z  (/)  is  likely 
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to  have  a  traffic  intensity  (loading)  close  to  one.  To  prevent  this,  several 
alternative  optimization  models  for  probabilistic  job  allocation  are  described 
below. 

The  first  model  minimizes  the  weighted  sum  of  squared  intensity  of  each 
server  and  can  be  stated  as  follows: 

I  (  }  .  .f 

P2:  minJ^Cj  A 

i=l  1,  j=l 

subject  to  constraints  (3.2),  (3.3),  and  (3.4). 

The  squared  objective  function  of  P2  penalizes  servers  with  higher  traffic 
intensity  more  than  those  with  lower  intensities.  P2  can  be  solved  as  a  quadratic 
programming  problem  (see,  e.g.,  Bazarra,  Sherali  and  Shetty,  1993).  Since  the 
objective  function  for  P2  is  convex,  the  solution  is  guaranteed  to  be  globally 
optimal. 

The  second  model  tends  to  equalize  the  traffic  intensity  among  all  servers  by 
minimizing  the  maximum  intensity,  i.e.. 


subject  to  constraints  (3.2),  (3.3),  and  (3.4). 

The  objective  function  for  P3  is  piecewise  linear  and  convex.  Thus,  P3  is  a 
nonlinear  programming  problem.  However,  it  can  be  converted  into  a  linear 
problem  by  introducing  an  auxiliary  variable  z  and  additional  constraints  to 
calculate  the  maximum  traffic  intensity  as  follows: 
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P4: 


minz 


subject  to  constraints  (3.2),  (3.3),  (3.4),  and 

/  r  1 

Vi  =  1,. . ./  (3.6) 

7=1 

An  optimal  solution  to  P4  tends  to  assign  jobs  to  servers  so  that  their  intensities 
all  equal  z*,  the  optimal  value  of  z. 

Replacing  constraint  (3.4)  with  the  following  constraint  translates  randomized 
job  allocation  problems  P2-P4  into  deterministic  ones. 

fly,- €{0,1}  V;  =  l,.../;  (3.7) 

Constraint  (3.7)  simply  restricts  fly,  to  be  either  0  or  1  and  the  resulting  problems 
become  integer  programming  problems,  a  more  difficult  class  of  problems  to 
solve.  However,  if  the  optimal  allocation  differs  from  the  allocation  in  (3.5),  then 
some  jobs  may  not  be  given  to  the  most  qualified  servers  and  the  optimal 
allocation  may  be  hard  to  accept  in  practice.  For  the  remainder,  we  focus  on  the 
randomized  job  allocation  problems  with  a  more  operationally  meaningful 
objective  (penalty)  function  based  on  expected  or  mean  job  delay,  or  mean  non- 
linearly-length-penalized  job  delay. 

3.2  Optimization  of  Mean  Fimctions  of  Total  Job  Delay 

The  Pollaczek-Khintchine-Kendall  formula  provides  the  expected  long-rim 
waiting  time  E[W],  at  an  M/G/ 1  system,  so  for  server  i  we  get 

ifp,.<l.  (3.8) 

A  type-;  job  arrives  in  (f,  t  +  dt)  with  probability  Xpjdt  +  o(,dt).  With  probability  fly,- 
it  is  then  assigned  to  server  i  where  it  experiences  a  total  expected  delay  in 
system  equal  to  E[Wf]  +  EfSy,].  Thus  the  total  expected  delay  for  a  job  of  type;  is 
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(3.9) 


1=1 

this  becomes  infinite  if  any  pi>l.  The  total  expected  long-run  weighted  delay  (per 
unit  time)  is 


D{a)  =  'l^jdj^Dj] 
7=1 


=  X'£pjdj 

;=i 


(3.10) 


i«;j(E[H'.]  +  £[s,,]) 
.1=1 


From  the  perspective  of  jobs  (or  customers),  it  is  natural  to  find  a  randomized  job 
allocation  that  minimizes  D(a)  by  solving  the  following  nonlinear  programming 
problem: 


P5: 


min 


YpA 

/=! 


.i=l 


(3.11) 


subject  to  constraints  (3.2),  (3.3),  and  (3.4) 
where  dj  is  the  weight  for  the  delay  of  job/.  When  dj  =  1,  the  objective  fimction  of 
P5  is  equivalent  to  minimizing  the  average  delay  of  all  /  jobs.  Alternately,  the 
following  problem  minimizes  the  maximum  expected  delay: 


P6: 


mm  max-? 

i 


.1=1 


(3.12) 


subject  to  constraints  (3.2),  (3.3),  and  (3.4). 


3.3  Mean  Non  Linear  Delay  Penalty 

Suppose  it  is  important  that  the  penalty  for  job  delays  be  more  stringent  for 
long  jobs,  and  in  a  manner  that  the  (linear)  long-run  expectation  of  total  delay 
does  not  reflect  adequately.  One  such  penalty  parameterization  is  exponential: 
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exact  penalty  £ 


where  >  0.  The  value  of  dj  is  a  decision  maker's 


choice.  Classical  M/G/1  theory  says  that  the  limiting  transform  is 


1-Pi 

LL  & 

1 

I 

_ A^__ _ — 

^E[e®A]-l' 

^  .0 

(3.13) 


provided  the  denominator  is  positive.  To  satisfy  this  requirement,  the  rate  of 
input  to  server  i  must  be,  in  general,  smaller  than  what  is  allowed  by  the 
expected  long-run  waiting  time  formula  in  (3.8).  Of  course, 

M  7  ;=i 

can  quickly  grow  large,  or  become  formally  infinite,  if  any  assignments  of  job 
type  /'  (denoting  members  of  a  subset  of  all  jobs)  are  submitted  to  server  i. 
Analogous  to  P5,  the  problem  of  minimize  weighted  penalty  can  be  written  as 
follows: 

(I 


P7 


/ 

rmn'^Pjdj 


i=l  ^ 


subject  to  constraints  (3.2),  (3.3),  (3.4),  and 


0<pi 


OiElSi] 


[<1  Vi  =  1,2,.../. 


(3.15) 


The  additional  constraint  is  to  ensure  that  the  expression  for  j  in  the 

objective  function  is  well  defined.  As  before,  when  dj  =  1,  P7  simply  minimizes 
the  average  delay  penalty  for  all  /  jobs.  Similarly,  the  problem  of  minimizing  the 
maximum  penalty  can  be  written  as 
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P8 

min  max  j 

1 _ 

j  1 

^  -“J 

subject  to  the  constraints  of  (3.2),  (3.3),  (3.4),  and  (3.15). 


4.  Incompatibility  Models 

Among  all  possible  job  to  server  assignments,  it  is  convenient  to  stipulate  that 


the  assignment  of  job  /  to  server  j  (or,  equivalently,  job  i  to  server  i)  is  the  most 
compatible,  i.e.,  ElSu]  <  E[Sji]  and  E  s|  <  E  s|- j  for  ;  it  i.  Below  are  two  incompat¬ 


ibility  models  that  fit  this  stipulation. 


4.1  Proportionality  Model 

Suppose  we  represent  incompatibility  simply  as  follows:  for  kji  >  1,  we 
assume  Sji  =  kjiSi,  so 

E[Sy.]  =  J:^£[Ss]  (4.1a) 

£[S|]  =  ):^S|]  (4.1b) 

for  y/  i.  Clearly  the  inequalities  noted  above  hold,  and  the  greater  k  is  made  the 
more  flagrant  is  the  incompatibility. 

4.2  Random  Interruption  Model 

An  alternative  and  physically  plausible  model  is  as  follows.  Let  Vji  denote  a 
Poisson  rate  of  interruptions  incurred  by  a  job  of  type  j  when  processed  on  server 
type  i.  These  interruptions  occur  when  the  server  must  consult  for  advice,  look 
for  necessary  materials,  or  rectify  a  breakdown  that  occurs.  It  is  assumed  here 
that  the  job  is  not  displaced  from  the  server's  attention  (set  aside)  during  the 
interruption,  so  no  other  jobs  may  be  done  during  the  interruption.  Analysis  of  a 
set-aside  option  will  be  conducted  later.  Let  Iji  denote  the  random  duration  of  an 
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interruption;  successive  interruptions  are  independent.  Let  s|-  be  the  effective 

service  time  for  server  i  to  complete  a  job  of  type  j,  including  the  interruptions 
that  occur.  Then 


where,  given  Su,  NiSu)  is  Poisson  {vjiSa). 

By  straightforward  conditioning  we  find 


i^if]  =  £[s,?](l  +  +  i-yiElSiilElEl] 


(4.2) 


(4.3) 

(4.4) 


5.  Numerical  Examples 

The  problems  presented  above,  PI,  P2,  P4,  P5,  P6,  P7,  and  P8  were  imple¬ 
mented  and  solved  using  the  General  Algebraic  Modeling  System  (GAMS) 
developed  by  Brooke,  Kendrick  and  Meeraus  (1992).  (Recall  that  P4  is  linear 
version  of  P3.)  Among  all  the  constraints  in  these  problems,  constraints  (3.2)  and 
(3.15)  cannot  be  implemented  on  a  finite  precision  computer.  Our  implemen¬ 
tation  replaces  equations  (3.2)  and  (3.15)  by  the  following: 

/  r  1 

^UPm^ji]  ^  0.99  Vi  =  1,.../.  (5.1) 

;=i 


(5.2) 


For  PI,  P2,  P4,  P5,  and  P6,  our  example  assumes  that  the  first  and  second 
moments  for  service  time  are  determined  by  the  random  interruption  model. 
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Results  for  the  proportionality  model  are  similar.  The  data  for  our  example  are  as 


follows: 

i)  /  =  /  =  6, 

ii)  The  weight  for  the  traffic  intensity  at  server  i,  Cp  equals  1  for  all  i, 

iii)  The  cost  of  delay  for  job  /,  dj,  equals  1  for  all  j, 

iv)  The  probability  of  an  incoming  job  being  of  type  j,  pj ,  is  as  follows: 


Job 

1 

2 

3 

4 

5 

6 

P/ 

0.29 

0.24 

0.19 

0.14 

0.10 

0.04 

v)  Vji  -  Round(l/(l,4))/  where  U(a,  h)  is  a  Uniform  random  variable  with 
parameters  a  and  h,  and  Round( )  rounds  a  number  to  the  nearest 
integer. 

Vi)  E[Iji]  =  U(0.5, 1 .5)  and  e[j|]  =  2E  [Jyi]2. 

vii)  E[Sz7]  =  U(0.5, 1.0)  and  e[s|]  =  2E[Sii]2. 

Table  1  shows  the  resulting  matrices  for  the  first  and  second  moments  generated 
based  on  the  data  from  v,  vi  and  vii. 


Table  1:  The  first  and  second  moments  of  the  time  server  i  takes  to  perform  job/. 


E[Sji] 


Serverl 

Server 2 

Servers 

Server4 

Servers 

Server6 

Jobl 

0.5364 

1.3056 

3,8214 

2.6083 

2.2060 

1,3083 

Job2 

1.3794 

0.5878 

2.4318 

5.1551 

1.2537 

2.0121 

Jobs 

2.4959 

1.6771 

0.7628 

3.7252 

1.5549 

0.9507 

Job4 

1.6340 

1.2613 

2.3811 

0.8751 

2.8333 

1.3421 

Jobs 

1.7820 

2.0643 

1.6229 

1.5611 

0.5891 

1.4267 

Job6 

1.5059 

1.9296 

3.1550 

2.2705 

2.1116 

0.5171 

Serverl 

Server2 

Servers 

Server4 

Servers 

Servers 

Jobl 

0.5754 

4.2853 

35.3372 

15.8944 

14.1712 

4.6341 

Job2 

5.1302 

0.6911 

15.4788 

63.6172 

4.6431 

10.9792 

Jobs 

16.0385 

6.9712 

1.1638 

32.3951 

5.8913 

2.5347 

Job4 

6.8372 

4.7252 

14.7727 

1.5316 

21.7556 

4.9190 

Jobs 

9.2434 

12.2305 

7.2066 

5.9493 

0.6940 

5.1381 

Job6 

5.7039 

10.5089 

24.9085 

11.7939 

12.8533 

0.5347 
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Using  the  above  data,  the  maximum  job  arrival  rate,  Amax/  can  be  obtained  by 
solving  the  following  linear  programming  problem: 

P9:  Amax  =max  A 

subject  to  constraints  (3.3),  (3.4),  and 

J  r  1 

A£pyflyiE[Sy^]<l  =  (5.3) 

;=1 

This  problem  yields  Amax  =  8.23.  Corresponding  to  this  Amax/  there  is  also  a 
feasible  allocation,  fly,-,  such  that 

J  r  1 

W  =  (5-« 

H 

Table  2  summarizes  the  results  for  three  different  arrival  rates:  low  (0.75Amax)/ 
medium  (O.SSAmax)  and  high  (0.95Ainax)-  The  first  two  allocations  mimimize  the 
sum  (PI)  and  the  squared  traffic  intensities  (P2)  yield  higher  delays  than  the 
other  three  allocations.  On  the  other  hand,  PI  and  P2  produce  smaller  traffic 
intensities  on  the  average.  However,  the  maximum  intensity  for  PI  and  P2  for  all 
three  arrival  rates  are  close  to  1.  Except  for  the  low  arrival  rate,  the  maximum 
traffic  intensity  for  both  PI  and  P2  is  0.99,  the  maximum  allowed  by  constraint 
(5.1).  This  may  not  be  desirable  in  practice. 

The  last  three  allocations  minimize  the  maximum  traffic  intensity  (P4), 
weighted  delays  (P5)  and  maximum  delay  (P6),  have  similar  average  intensity. 
Since  minimizing  the  maximum  traffic  intensity  does  not  directly  take  into 
account  the  delay,  P4  generates  slightly  higher  job  delays  than  the  other  two. 
Observe  that  the  traffic  intensity  for  P4  is  the  same  for  every  server.  Similarly,  the 
expected  delay  for  every  job  is  the  same  for  problem  P6. 
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Table  2:  Stunmary  of  results  from  various  optimization  problems 


Low  Arrival  Rate: 

PI 

P2 

P4 

PS 

P6 

Minimize 

Minimize 

Minimize 

Minimize 

Minimize 

Sum  Traffic 

Sq.  Traffic 

Max  Traffic 

Weighted 

Max  Delay 

Intensity 

Intensity 

Intensity 

Delay 

MIN  E [Delay] 

0.5927 

1.0592 

2.7176 

2.0935 

3.0698 

AVE  £ [Delay] 

5.0440 

4.2503 

3.6594 

2.9473 

3.0698 

MAX  £ [Delay] 

13.3894 

13.3894 

5,0153 

3.5874 

3.0698 

MIN  INTENS 

0.1276 

0.4002 

0.7500 

0.5850 

0.6353 

AVE  INTENS 

0.6620 

0.6774 

0.7500 

0.7218 

0.7304 

MAX  INTENS 

0.9599 

0.9599 

0.7500 

0.8183 

0.8170 

Medium  Arrival  Rate:  A  =  O.SSAmax 

PI 

P2 

P4 

PS 

P6 

Minimize 

Minimize 

Minimize 

Minimize 

Minimize 

Sum  Traffic 

Sq.  Traffic 

Max  Traffic 

Weighted 

Max  Delay 

Intensity 

Intensity 

Intensity 

Delay 

MIN  E [Delay] 

1.0018 

1.1739 

4.5287 

3.8327 

5.2134 

AVE  E [Delay] 

31.8809 

13.4553 

6,2890 

5.1513 

5.2134 

MAX  E [Delay] 

74.5428 

49.1424 

9.0138 

6.1985 

5.2134 

MIN  INTENS 

0.4097 

0.4535 

0.8500 

0.7383 

0.7608 

AVE  INTENS 

0.7748 

0.7861 

0.8500 

0,8316 

0.8357 

MAX  INTENS 

0.9900 

0.9900 

0.8500 

0.8930 

0.8936 

High  Arrival  Rate: 

A  —  0*95Ajj|^ 

PI 

P2 

P4 

PS 

P6 

Minimize 

Minimize 

Minimize 

Minimize 

Minimize 

Sum  Traffic 

Sq.  Traffic 

Max  Traffic 

Weighted 

Max  Delay 

Intensity 

Intensity 

Intensity 

Delay 

MIN  E [Delay] 

2.9863 

2.9863 

13.5844 

12.2416 

16.0495 

AVE  E [Delay] 

33.9351 

33.9351 

19.4372 

16.2206 

16.0495 

MAX  E [Delay] 

68.2769 

68.2769 

29.0061 

20.6084 

16.0495 

MIN  INTENS 

0.7010 

0.7010 

0.9500 

0.9118 

0.9124 

AVE  INTENS 

0.9199 

0.9199 

0.9500 

0.9437 

0.9442 

MAX  INTENS 

0.9900 

0.9900 

0.9500 

0.9640 

0.9661 

It  is  interesting  to  note  that  problems  P5  and  P6  which  minimize  functions  of 
job  delays  produce  allocations  with  traffic  intensities  similar  to  those  generated 
by  P4  which  minimizes  the  maximum  intensity.  This  similarity  is  probably  due 


to  the  fact  that,  from  (3.8),  lower  traffic  intensity  implies  shorter  waiting  time 
which,  in  turn,  implies  shorter  delay  via  (3.9).  Moreover,  this  similarity  illustrates 
that  planning  from  the  two  perspectives,  servers  or  jobs  (customers),  does  not 
have  to  always  be  conflicting. 
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Problem  P4,  minimizing  the  maximum  traffic  intensity,  tends  to  equalize  the 
intensity  at  all  servers.  In  Table  2,  the  minimum,  average,  and  maximum  values 

of  traffic  intensity  for  P4  all  equal ,  if  A,  =  a^max-  In  fact,  the  solution  to  problem 
P9,  i.e.,  flyf,  also  solves  P4  because  Ujj  is  a  feasible  allocation  and  multiplying  (5.3) 

by  a  yields  the  following 

/  r  1 

/=! 

/  r  1 

=  «  V/  =  1,...,/. 

H 

So,  the  allocation  Up  produces  the  same  traffic  intensity,  a,  at  all  servers.  Since  a 
is  the  maximum  intensity,  fly/  must  be  optimal  to  P4  also. 

Unlike  the  other  problems,  the  distribution  for  service  times  must  be  specified 
for  problems  P7  and  P8.  To  simplify  our  illustration,  replace  v  to  vii  with  the 
following: 

viii)  The  service  time  S//  has  a  gamma  distribution  with  parameters  a/  and 
Pi,  and 

4%]  =  A/«i  E[s|]  =  (/8=^+/0/)/a?,and 

ix)  The  service  time  Sy/  has  a  gamma  distribution  with  parameters  o/  and 
^jiPi/  ^nd 

“  ^jiPi  ^nd  cj^Sy/ j  =  ^^jiPi j  +  kjiPi  ^  j CCi  • 

The  above  assumptions  is  similar  to  the  proportionality  model,  in  that  equation 
(4.1a)  holds.  However,  equation  (4.1b)  does  not  and  the  following  holds  instead: 

£[s|]<;c|E[si]  V/*;. 
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Moreover, 


E 


For  our  example. 


Vz  and  j. 


1)  ai  =  1  and  ^  =  2  V  z 

2)  V;>i. 

Determining  the  value  of  Amax  now  requires  solving  problem  P9  with  the 
addition  of  the  following  constraint: 


0<Pi 


E 

-1 

©,E[Si]  J 

<1,  Vz. 


(5.5) 


Since  (5.5)  depends  on  6,  improper  choice  for  0  may  render  problems  P7  and  P8 
infeasible.  Figure  1  below  displays  a  graph  of  /Imax  as  a  function  of  d  under  the 
assumption  that  0/  =  0  for  all  z.  So,  the  choice  of  6  limits  the  application  of 


Figiire  1:  A  graph  of  Amax  as  a  function  of  6  under  the  assumption  that  Oi  =  ©for  all  i. 
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problem  P7  and  P8.  Certainly,  when  the  arrival  rate  is  0.7,  it  is  not  possible  to 
choose  0  to  be  1  and  vice  versa.  Tables  3  and  4  compare  the  results  with  d  =  0.7 
for  two  pairs  of  problems,  P5  &  P7  and  P6  &  P8,  respectively.  In  Table  3, 
minimizing  weighted  job  delays  (P5)  and  job  penalties  (P7)  generate  similar  job 
delays  for  all  three  arrival  rates.  On  the  other  hand,  only  the  job  penalties  for  low 
arrival  rate  are  similar.  At  the  high  arrival  rate,  the  infinite  penalties  for  jobs  1 
and  6  imder  P5  indicate  that  the  penalty  function  is  undefined,  i.e.,  constraint 
(3.15)  is  not  satisfied.  Problems  P6  and  P8  display  a  similar  behavior  in  Table  4. 


Table  3:  Comparing  job  delays  and  penalties  for  problems  P5  and  P7. 


Low  Arrival  Rate:  A  = 

0.75Ajnax 

P7:  Minimize 

P5:  Minimize 

Weighted  Penalty 

Weighted  Delay 

DELAY 

PENALTY 

DELAY 

PENALTY 

Job  1 

1.1957 

4.3649 

1.2562 

6.0654 

Job  2 

1.0157 

3.4013 

1.0504 

3.7571 

Job  3 

0.9296 

2,8850 

0.8663 

2.5424 

Job  4 

0.8693 

2.7167 

0.7537 

2.1365 

Job  5 

0.8134 

2.5799 

0.7008 

2.0217 

Job  6 

0.7664 

2.6051 

0.7668 

2.6076 

Ave 

1.0008 

3.3728 

0.9873 

3.7493 

Medium  Arrival  Rate:  A 

P7:  Minimize 

P5:  Minimize 

Weighted  Penalty 

Weighted  Delay 

DELAY 

PENALTY 

DELAY 

PENALTY 

Job  1 

1.3395 

6.4635 

1.4309 

14.1940 

Job  2 

1.1525 

4.9695 

1.1788 

5.4984 

Job  3 

1.0767 

4.1320 

0.9700 

3,1213 

Job  4 

1.0059 

3.8486 

0.8595 

2.5732 

Job  5 

0.9456 

3,7056 

0.8320 

2.6513 

Job  6 

0.8858 

3.8450 

0.9493 

5.1916 

Ave 

1.1404 

4.9153 

1.1237 

6.8620 

High  Arrival  Rate:  A  = 

0-95Amax 

P7 :  Minimize 

P5:  Minimize 

Weighted  Penalty 

Weighted  Delay 

DELAY 

PENALTY 

DELAY 

PENALTY 

Job  1 

1.5106 

15,5540 

1.6392 

oo 

Job  2 

1.3238 

11.5910 

1.3401 

14.0168 

Job  3 

1.2673 

9.3830 

1.1036 

4.4200 

Job  4 

1.1917 

8.8212 

0.9955 

3.4966 

Job  5 

1,1185 

8.6550 

0.9977 

4.3668 

Job  6 

1.0326 

9.2758 

1.1772 

oo 

Ave 

1,3166 

11.5468 

1.2929 

N/A 
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Table  4:  Comparing  job  delays  and  penalties  for  problems  P6  and  P8. 


Low  Arrival  Rate: 

A  = 

P8:  Minimize 

P6:  Minimize 

Maximum  Penalty 

Maximum  Delay 

DELAY 

PENALTY 

DELAY 

PENALTY 

Job  1 

1.1188 

3.7831 

1.0998 

3.8200 

Job  2 

1.0730 

3.7831 

1.0998 

3.8304 

Job  3 

1.0803 

3.7831 

1.0998 

3.7653 

Job  4 

1.0649 

3.7831 

1.0998 

4.0381 

Job  5 

1.0209 

3.7831 

1.0998 

4.0422 

Job  6 

0.8637 

3.0756 

1.0025 

3,8652 

Ave 

1.0729 

3.7548 

1.0959 

3.8667 

Medium  Arrival  Rate::  A  =  0.85^ax 

P8:  Minimize 

P6:  Minimize 

Maximum  Penalty 

Maximum  Delay 

DELAY 

PENALTY 

DELAY 

PENALTY 

Job  1 

1.2847 

5.6349 

1.2438 

5.4339 

Job  2 

1.2045 

5.6349 

1.2438 

6.3660 

Job  3 

1.1525 

5.6349 

1.2438 

8.7200 

Job  4 

1.0736 

4.9570 

1.2438 

12.7694 

Job  5 

1.1845 

5.6349 

1.2438 

13.7092 

Job  6 

1.0599 

5.2289 

1.2438 

21.1060 

Ave 

1.1918 

5.5237 

1.2438 

8.7634 

High  Arrival  Rate: 

A=0.95A^ax 

P8:  Minimize 

P6:  Minimize 

Maximum  Penalty 

Maximum  Delay 

DELAY 

PENALTY 

DELAY 

PENALTY 

Job  1 

1.4910 

13.1304 

1.4212 

15.6351 

Job  2 

1.3354 

13.1304 

1.4212 

6.7326 

Job  3 

1.3079 

13.1304 

1.4212 

15.5092 

Job  4 

1.2246 

11.9743 

1.4212 

1.2211 

Job  5 

1.1317 

9.6943 

1.4212 

oo 

Job  6 

1.0162 

7.9914 

1.2959 

oo 

Ave 

1.3267 

12.4194 

1.4162 

N/A 

6.  Application 

One  application  of  the  optimization  problems  is  in  quantifying  the  benefit  of 
additional  training.  In  all  of  the  above  examples,  ps  =  0.04.  So,  there  are  not  many 
jobs  of  type  6  in  the  system.  Therefore,  server  6,  who  is  the  expert  for  job  type  6, 
has  to  process  other  types  of  jobs  in  order  to,  e.g.,  minimize  the  maximum 
expected  delay  among  all  6  job  types,  (problem  P6).  In  order  to  improve  this 
performance  measure,  it  is  logical  to  train  server  6  to  become  an  expert  at 
processing  another  job  besides  job  6.  Assume  that,  if  server  6  is  trained  to  process 
job  i,  then 
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£[S6i]  =  £[Si;]andE[s|i]  =  E[si]. 

By  resolving  problem  P6  with  the  first  two  moments  of  its  service  times  suitably 
modified,  the  training  benefit  for  server  6  can  be  measured  quantitatively.  Using 
data  from  the  interruption  model  above  (i.e.,  i  -  vii)  and  high  arrival  rate.  Figure 
2  displays  the  maximum  delay  for  each  training  alternative. 


Figure  2:  Maximum  Job  Delay  vs.  Training  Alternatives  for  Server  6 

As  expected,  it  is  best  to  train  server  6  to  process  job  1,  for  doing  so  deaeases  the 
maximum  job  delay  by  the  largest  amount. 

In  general,  it  is  also  possible  to  formulate  an  optimization  problem  for 
assigning  servers  to  training  programs  for  a  given  budget  constraint. 
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22.  Dr.  M.  J.  Fischer . 1 
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Reston,VA  22070 

23.  Prof.  George  S.  Fishman . 1 
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Dept,  of  Operations  Research 
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1800  North  Beauregard 

Alexandria,  VA  22311 
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P.O.  Box  363 
Birmingham  B15  2TT 
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Department  of  Statistics 
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Pittsburgh,  PA  15213 

39.  CAPT  (Sel)  Mike  Lilienthal . 1 
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40.  Dr.  D.  M.  Lucantoni . 1 
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University  of  Pittsburgh 
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. 1 

49. 
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. 1 

50. 

Prof.  Maria  Rieders . 
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51. 

Dr.  Rhonda  Righter . 
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Santa  Clara,  CA  95118 
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52. 
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The  Management  Science  Group 
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University  of  California 

Berkeley,  CA  94720 

. 1 
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NEW  ZEALAND 
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